>^fr 

means due, for example, to differences in calibration, then the input signals will be pre- 
normalized to the same nominal mean values during initial operation. 

The specific goal of the A 1 engine is to declare system 1 or system 2 degraded 
if the drift in Y is sufficiently large that the sequence of observations appears to be distributed 
about means + M or - M, where M is a preassigned system distribution magnitude. The 
SPRT provides a quantitative framework that enables us to decide between two hypotheses, H 
and H2, namely: 

HI : Y is drawn from a Gaussian product distribution function (PDF) with 
means M and variance a 2 . 

H2: Y is drawn from a Gaussian PDF with mean O and variance a 2 . 

If it is supposed that HI or H2 is true, we wish to decide for HI or H2 with 
probability (1-P) or (1-ot) respectively, where a and p represent the error (misidentification) 
probabilities. 

From the theory described by Wald and Wolfowitz in "Optimum Character of 
the Sequential Probability Ratio Test, "Ann. Math. Stat., 19,326 (1948), the most powerful 
test depends on the likelihood ratio l n , where 

Probability of observed sequence given HI true. 



t = yi y n 

yxji^.^yn 

Probability of observed sequence given H2 true. 
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After n observations have been made, the sequential probability ratio is just the 
product of the probability ratio is just the product of the probability ratios for each step: 

l m =(PRl).(PR2)-(PR3): . .(PR m ) 
or 

■ f(yi\H } ) 

K~ n ; > 

f(yi\H 2 ) 

where F(y\H) is the distribution of the random variable^. 

the Wald-Wolfowitz theory operates as follows: 
Continue sampling as long as 

A<\n<B (1) 
Stop sampling and decide HI as soon as and stop sampling and decide H2 as 

soon as 1 <A. The acceptance thresholds are related to the error (misidentification) 

probabilities by the following expressions: 



A = -@-andB = ] —^ (2) 
l-a a 

where 



a = probability of accepting HI when H2 is true (false alarm probability) 
fi = probability of accepting// 2 when HI is true (missed alarm probability) 

Assuming the random variable y k is normally distributed, the likelihood that //l 
is true (mean M, variance a 2 ) is given by 
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L{y\, y2, y3,... yn\H\) = 1 exp 

a 



lex 2 



2 



\k=\ 



k=\ J 



• (3) 



Similarly for HI (means o, variance a ), 



L (y\ >yi ^3 - • • y n \ H1 ) = 77— 77 



(2^) n/ V n 



exp 



1 rt 



2a 2 £ 



(4) 



1 / 



The ratio of equations (3) and (4) gives the likelihood ratio 1 ; where 1 is 



expressed as 



where 



K =exp 



-1 



2<r' ^ 



(5) 



combining equations 1, 2 and 5, and taking the natural logs, gives 

/. \fi /(l - a)] < J M(M - 2y k ) < /„ [(1 - fi)a] 

la jt=i 



SPRT = —^X M ( M ~ 2 y^ or 

2(7 k -\ 



as 



then the sequential sampling and decision strategy can be concisely represented 

If SPRT<l n (p/l-a) accept H2 

If 1 [p/(l-oc)]<SPRT<l [(l-p)/a], 
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continue sampling 

If SPRT>l n [(l-p)/a] accept HI. 

The SPRT analysis formulated here cannot be applied directly to non-Gaussian 
signals. For applications to nuclear system signals contaminated by non-Gaussian noise, an 
attempt should first be made to pretreat the input signals with a normalizing transformation. 

For applications where (a) one requires a high degree of assurance that a system 
is functioning within specifications and (b) there is not a large penalty associated with false 
alarms, it is not uncommon to specify a B (missed alarm probability) that is much smaller than 
A (false alarm probability). In safety critical systems one may be more willing to incur a false 
alarm than a missed alarm. For applications where a large cost penalty is incurred with any 
false alarms, it is desirable to keep both A and B small. 

The trade-off that must be considered before one specifies arbitrarily small 
values for A and B is the effect this may have on the sensitivity and maximum decision time 
needed by the SPRT to annunciate a disturbance. The desired sensitivity of the SPRT is fixed 
by specification of M, the system disturbance magnitude. For a given value of M, the average 
sample number required to reach a decision is influenced by A and B and also by the variance 
associated with the signals being monitored. It takes longer to identify a subtle change in a 
process characterized by a low signal-to-noise ratio than in one with a high signal-to-noise 
ratio. 

The non-stationary version of the SPRT algorithm is a slightly modified version 
of Wald's SPRT. In the non-stationary case, the failure magnitude, M, reference signal (or 
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mean), ji, and the reference variance, cr 2 , are sample dependent. Therefore, the non-stationary 
SPRT equation becomes 

SPRT(„) = SPJ.7X.-1) ♦ W«) - *»» - ^1. 

a (n)\ 2 J 

where n = 1,2,...,L and L is the length of the length equalized signals. In this 
case, y(n) is the length of the equalized monitored signal, ju(n) is the corresponding reference 
signal generated during the training phase and o^n) is the variance of each point in |i(n). 

The bounded angle ratio test (hereinafter BART) mentioned above is employed 
in systems with more than two variables, as shown in FIG. 9. For example, BART can be 
used on an actual sensor signal exhibiting non- white characteristics, such as for example, on 
sensor signals from the primary pump #2 of the EBR-II nuclear reactor at Argonne National 
Laboratory (West) in Idaho. In such a case, the signal can be a measure of the pump's speed 
over a given amount of time. In such a situation, one can use a nonlinear multivariate 
regression technique that employs an N Dimensional Space (known in vector calculus 
terminology as hyperspace) to model the relationships between all of the variables. This 
regression procedure results in a nonlinear synthesized estimate for each input observation 
vector based on the hyperspace regression model. The nonlinear multivariate regression 
technique is centered around the hyperspace BART operator that determines the element by 
element and vector to vector relationships of the variables and observation vectors, given a set 
of system data that is recorded during a time period when everything is functioning correctly. 

In the BART method described in FIG. 9., the method is also split into a 
training phase and a monitoring phase. The first step in the training phase is to acquire a data 
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matrix continuing data samples from all of the sensors (or data sources) used for monitoring 
the system that are coincident in time and are representative of normal system operation. Then 
the BART parameters are calculated for each sensor (X , X and X ). Here X is the 

med max min med 

median value of a sensor. The next step is to determine the similarity domain height for each 
sensor (h) using the BART parameters X , X and X . Once these parameters are 

* med max min 

calculated a subset of the data matrix is selected to create a model matrix (H) that is used in the 
BART estimation calculations. Here, H is an NxM matrix where N is the number of sensors 
being monitored and M is the number of observations stored from each sensor. The last steps 
taken during the training phase are the SPRT parameters calculations. The calculations are 
analogous to the calculations in the other methods, except that now the standard deviation 
value used to calculate SDI is obtained from BART estimation errors from each sensor (or data 
source) under normal operating conditions. 

During the BART monitoring phase, a sample vector is acquired at each time 
step t, that contains a reading from all of the sensors (or data sources) being used. Then the 
similarity angle (SA) between the sample vector and each sample vector stored in H is 
calculated. Next an estimate of the input sample vector Y is calculated using the BART 
estimation equations. The difference between the estimate and the actual sensor values is then 
used as input to the SPRT module. Each difference is treated separately so that a decision can 
be made on each sensor independently. This method is described in more detail hereinafter. 

In this preferred embodiment of FIG. 9 of the invention, the method measures 
similarity between scalar values. BART uses the angle formed by the two points under 
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comparison and a third reference point lying some distance perpendicular to the line formed by 
the two points under comparison. By using this geometric and trigonometric approach, BART 
is able to calculate the similarity of scalars with opposite signs. 

In the most preferred form of BART an angle domain must be determined. The 
angle domain is a triangle whose tip is the reference point (R), and whose base is the similarity 
domain. The similarity domain consists of all scalars which can be compared with a valid 
measure of similarity returned. To introduce the similarity domain, two logical functional 
requirements can be established: 

0 The similarity between the maximum and minimum values in the similarity domain is 0, 
and 

1 the similarity between equal values is 1 . 

Thus the similarity range (i.e. all possible values for a measure of similarity), is in the range 0 
to 16 inclusive. 

BART also requires some prior knowledge of the numbers to be compared for 
determination of the reference point (R). Unlike a ratio comparison of similarity, BART does 
not allow "factoring out" in the values to be compared. For example, with the BART 
methodology the similarity between 1 and 2 is not necessarily equal to the similarity between 2 
and 4. Thus, the location of R is vital for good relative similarities to be obtained. R lies over 
the similarity domain at some distance h, perpendicular to the domain. The location on the 
similarity domain at which R occurs (X ) is related to the statistical distribution of the values 

J med 

to be compared. For most distributions, the median or mean is sufficient to generate good 
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results. In a preferred embodiment the median is used since the median provides a good 
measure of data density and is resistant to skewing caused by large ranges of data. 

Once X has been determined, it is possible to calculate h. In calculating h, it 
is necessary to know the maximum and minimum values in the similarity domain. (X and 
X respectively) for normalization purposes the angle between X and X is defined to be 

min A A min max 

90°. The conditions and values defined so far are illustrated in FIG. 10. From this triangle it 
is possible to obtain a system of equations and solve for h as shown below: 

c-X -X 

med min 

d-X -X 

max med 

aV=h 2 (19) 

, 2 , 2 , 2 

b =d +h 
(c+d) =a +b 
(c+d) =c +d +2h 
h 2 =cd 
h = Vcd 

Once h has been calculated the system is ready to compute similarities. Assume 
that two points: X 0 and X! (Xq < X,) are given as depicted in FIG. 11 and the similarity 
between the two is to be measured. The first step in calculating similarity is normalizing Xq 
and X, with respect to X . This is done by taking the euclidean distance between X^ and 

each of the points to be compared. Once X 0 and X, have been normalized, the angle ZXqRX, 
(hereinafter designated 9) is calculated by the formula: 



G = ArcTan(X,|h) = ArcTan(Xojh) (20) 
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After 9 has been found, it must be normalized so that a relative measure of 
similarity can be obtained that lies within the similarity range. To ensure compliance with 
functional requirements (A) and (B) made earlier in this section, the relative similarity angle 
(SA) is given by: 

£4 = 1- — (21) 
90° 

Formula (21) satisfies both functional requirements established at the beginning 
of the section. The angle between X and X was defined to be 90°, so the similarity 

min max 

between X and X is 0. Also, the angle between equal values is 0° The SA therefore will 

min max 

be confined to the interval between zero and one, as desired. 

To measure similarity between two vectors using the BART methodology, the 
average of the element by element SAs are used. Given the vectors x x and x 2 the SA is found 
by first calculating S 4 for i= l,2,3...n for each pair of elements in x x and x 2 i.e., 

if fL = [AT„ X» Xu ■ ■ ■ XuW ^1 = [Xn Xn X 2 y Xj 
The vector SA V is found by averaging over the Si's and is given by the following 
equation: 

r = -f d S i (22) 

n M 

In general, when given a set of multivariate observation data from a process (or 
other source of signals), linear regression could be used to develop a process model that relates 
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all of the variables in the process to one another. An assumption that must be made when 
using linear regression is that the cross-correlation information calculated from the process 
data is defined by a covariance matrix. When the cross-correlation between the process 
variables is nonlinear, or when the data are out of phase, the covariance matrix can give 
misleading results. The BART methodology is a nonlinear technique that measures similarity 
instead of the traditional cross-correlation between variables. One advantage of the BART 
method is that it is independent of the phase between process variables and does not require 
that relationships between variables be linear. 



If there is a random observation vector y and a known set of process observation 
vectors from a process P, it can be determined if y is a realistic observation from a process P 
by combining BART with regression to form a nonlinear regression method that looks at 
vector SAs as opposed to euclidean distance. If the know observation vectors taken from P are 
given by 



h 



21 



'32 



A, V"*.] (23) 



where H is k by m (k being the number of variables and m the number of observations), 
then the closest realistic observation vector to y in process P given H is given by 

y = Hw (24) 
Here w is a weighting vector that maps a linear combination of the observation vectors 
in H to the most similar representation of y. The weighting vector w is calculated by 
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combining the standard least squares equation form with BART. Here 0 stands for the SA 
operation used in BART. 

w = (H' 0 H)'^' © y (25) 
An example of use of the BART methodology was completed by using 10 EBR- 
II sensor signals. The BART system was trained using a training data set containing 1440 
observation vectors. Out of the 1440 observation vectors, 129 of these were chosen to be used 
to construct a system model. The 129 vectors were also used to determine the height, h, of the 
angle domain boundary as well as the location of the BART reference point R for each of the 
sensors used in the experiment. To test the accuracy of the model 900 minutes of one minute 
data observation vectors under normal operating conditions were run through the BART 
system. The results of the BART system modeling accuracy are shown in FIGS. 12-16 and 
FIGS. 17-21 (BART modeled). The Mean Squared Errors for each of the sensor signals is 
shown in Table III. 



TABLE III 


BART System Modeling Estimation Mean Squared Errors 1 


for EBR-II Sensor Signals 












Sensor 
Channel 


Sensor Description 


MSE of 
Estimation 
Error 


Normalized 

MSE 
(MSE/H,) 


Normalized 

MSE 
(MSE/o,) 


1. 


Primary Pump #1 Power (KW) 


0.0000190 


0.0000002 


0.0002957 


2. 


Primary Pump #2 Power (KW) 


0.0000538 


0.0000004 


0.0004265 


3. 


Primary Pump #1 Speed (RPM) 


0.0000468 


0.0000001 


0.0005727 


4. 


Primary Pump #2 Speed (RPM) 


0.0000452 


0.0000001 


0 0004571 


5. 


Reactor Outlet Flowrate (GPM) 


8.6831039 


0.0009670 


0.1352974 


6. 


Primary Pump #2 Flowrate (GPM) 


0.0571358 


0.0000127 


0.01.63304 


7. 


Subassembly Outlet Temperature 1A1 (F) 


0.0029000 


0.0000034 


0.0062368 


8. 


Subassembly Outlet Temperature 2B1 (F) 


0.0023966 


0.0000027 


0.0052941 


9. 


Subassembly Outlet Temperature 4E1 (F) 


0.0025957 


0.0000029 


0.0050805 


10. 


Subassembly Outlet Temperature 4F1 (F) 


0.0024624 


0.0000028 


0.00 1358 
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